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ABSTRACT 

This  paper  addresses  the  problem  of  probabilistic  reasoning  as  it  applies  to  Truth  Maintenance 
Systems.  A  Belief  Maintenance  System  has  been  constructed  which  manages  a  current  set  of 
probabilistic  beliefs  in  much  the  same  way  that  a  TMS  manages  a  set  of  true/false  beliefs.  Such 
a  system  may  be  thought  of  as  a  generalization  of  a  Truth  Maintenance  System.  It  enables  one 
to  reason  using  normal  two  or  three-valued  logic  or  using  probabilistic  values  to  represent  partial 
belief.  The  design  of  the  Belief  Maintenance  System  is  described  and  some  problems  are 
discussed  which  require  further  research.  Finally,  some  examples  are  presented  which  show  the 
utility  of  such  a  system.  ^  >, 


This  is  a  revised  version  of  a  paper  which  appears  in  the  Proceedings  of  the  Second  Workshop  on 
Uncertainty  and  Probability  in  Artificial  Intelligence,  Philadelphia,  August,  1986. 


This  research  is  supported  by  the  Office  of  Naval  Research,  Contract  No.  N00014-85-K-0559. 
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1.  INTRODUCTION 

There  currently  exists  a  gap  between  the  theories  proposed  by  the  probability  and 
uncertainty  community  and  the  needs  of  Artificial  Intelligence  research.  These  theories  primarily 
address  the  needs  of  expert  systems,  proposing  computational  models  using  knowledge  structures 
which  must  be  pre-compiled  and  remain  static  in  structure  during  runtime.  Many  AI  systems 
require  the  ability  to  dynamically  add  and  remove  parts  of  the  current  knowledge  structure  (e.g. 
in  order  to  examine  what  the  world  would  be  like  for  different  causal  theories).  This  requires 
more  flexibility  than  existing  uncertainty  systems  display.  In  addition,  many  AI  researchers  are 
only  interested  in  using  "probabilities"  as  a  means  of  obtaining  an  ordering,  rather  than 
attempting  to  derive  an  accurate  probabilistic  account  of  a  particular  situation.  This  indicates 
the  need  for  systems  which  stress  ease  of  use  and  don’t  require  extensive  amounts  of  conditional 
probability  information  when  one  cannot  (or  doesn’t  wish  to)  provide  such  information.  This 
paper  attempts  to  help  reconcile  the  gap  between  approaches  to  uncertainty  and  the  needs  of 
many  AI  systems  by  examining  the  control  issues  which  arise,  independent  of  a  particular 
uncertainty  calculus,  when  one  tries  to  satisfy  these  needs. 

Truth  Maintenance  Systems  have  been  used  extensively  in  problem  solving  tasks  to  help 
organize  a  set  of  facts  and  detect  inconsistencies  in  the  believed  state  of  the  world.  These 
systems  maintain  a  set  of  true/false  propositions  and  their  associated  dependencies.  In  trying  to 
reason  about  real  world  problems,  however,  situations  often  arise  in  which  we  are  unsure  of 
certain  facts  or  in  which  the  conclusions  we  can  draw  from  available  information  are  somewhat 
uncertain.  The  non-monotonic  TMS  (Doyle,  1979;  McDermott  and  Doyle,  1980)  was  an  attempt 
at  reasoning  when  all  the  facts  are  not  known.  Non-monotonic  systems,  however,  fail  tc  take 
into  account  degrees  of  belief  and  how  available  evidence  can  combine  to  strengthen  a  particular 
belief. 

This  paper  addresses  the  problem  of  probabilistic  reasoning  as  it  applies  to  Truth 
Maintenance  Systems.  It  describes  a  Belief  Maintenance  System  that  manages  a  current  set  of 
beliefs  in  much  the  same  way  that  a  TMS  manages  a  current  set  of  true 'false  propositions.  If  the 
system  knows  that  our  belief  in  factj  is  dependent  in  some  way  upon  our  belief  in  fact,,  then  it 
automatically  modifies  our  belief  in  factt  if  we  give  it  some  new  information  which  causes  a 
change  in  belief  of  fact,.  It  models  the  behavior  of  a  normal  TMS,  replacing  its  3-valued  logic 
(true,  false,  unknown)  with  an  infinite-valued  logic,  in  such  a  way  as  to  reduce  to  a  standard 
TMS  if  all  statements  are  given  in  absolute  true,  false  terms.  We  can  therefore  think  of  Belief 
Maintenance  Systems  as  simply  a  generalization  of  Truth  Maintenance  Systems,  whose  possible 
reasoning  tasks  are  a  superset  of  those  for  a  TMS. 

2.  DESIGN 

The  design  of  the  belief  maintenance  system  is  based  on  current  TMS  technology, 
specifically  a  monotonic  version  of  Doyle’s  justification-based  TMS  ( 1979).  As  in  the  TMS.  a 
network  is  constructed  which  consists  of  nodes  representing  facts  and  justification  links  between 
nodes  representing  antecedent  support  of  a  set  of  nodes  for  some  consequent  node.  The  BMS 
differs  in  that  nodes  take  on  a  measure  of  belief  rather  than  true  or  false  and  justification  links 
become  support  links  in  that  they  provide  partial  evidence  in  favor  of  a  node. 

The  basic  design  consists  of  three  parts:  (1)  the  conceptual  control  structure.  (2)  the  user 
hooks  to  the  knowledge  base,  and  (3)  the  uncertainty  calculus.  A  simple  parser  is  used  to 
translate  user  assertions  (e.g.  (implies  (and  a  b)  c)  )  into  control  primitives.  This  enables 
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the  basic  design  to  be  semi-independent  of  the  belief  system  used.1  All  that  is  required  of  the 
belief  formalism  is  that  it  is  invertable.  Specifically,  if  A  provides  support  for  B  and  our  belief  in 
A  changes,  we  must  be  able  to  remove  the  effects  the  previous  belief  in  A  had  on  our  belief  in  B. 

2.1.  An  Overview  of  Dempster-Shafer  Theory 

The  particular  belief  system  used  here  is  based  on  the  Dempster-Shafer  theory  of  evidence 
(Shafer,  1978:  Barnett,  1981:  Garvey  et  al.  1981).  This  theory  combines  Dempster’s  rule  for  the 
combination  of  belief  functions  with  Shafer’s  representation  of  beliefs.  Shafer’s  representation 
expresses  the  belief  in  some  proposition  A  by  the  interval  [  s(A),  p(A)  ).  s(A)  represents  the 
current  amount  of  support  for  A  or  the  minimum  probability  of  A.  p(A)  is  the  plausibility  of  A 
and  establishes  a  maximum  probability  for  A.  It  is  often  best  to  think  of  p(A)  in  terms  of  the 
lack  of  evidence  against  A,  for  p(A)  =  1  -  s(-»A).  In  this  representation,  the  uncertainty  of  A’s 
probability  is  given  by  p(A)  -  s(A).  To  simplify  calculations,  the  belief  maintenance  system 
represents  Shafer  intervals  by  the  pair  (s(A)  s(— »A))  rather  than  the  interval  's(A)  p(A)l 
(Ginsberg,  1984). 

Dempster  s  rule  provides  a  means  for  combining  probabilities  based  upon  different  sources 
of  information.  His  language  of  belief  functions  defines  a  frame  of  discernment,  0,  as  the 
exhaustive  set  of  possibilities  or  values  in  some  domain.  For  example,  if  the  domain  represents 
the  values  achieved  from  roiling  a  die.  0  is  the  set  of  6  propositions  of  the  form  ’the  die  rolled  a 
j."  If  mt  and  m,  are  two  basic  probability  functions  over  the  same  space  0,  each  representing  a 
different  knowledge  source,  then  Dempster’s  rule  defines  the  new  combined  probability  function 
m  for  all  subsets  C  of  0  to  be 


-n(C)  - 


S.ps.  -  c 


1-  E  •n!(A)m2(5.) 

*,n»,  -  • 

This  is  also  known  as  Dempster  s  orthogonal  sum  and  is  stated  as  m  =  mt  0  m2.  Note  that  the 
denominator  is  a  normalizing  factor,  removing  probability  given  to  the  empty  set  and  ensuring 
that  the  totai  probability  for  the  new  function  is  still  one. 

Since  our  primary  interest  here  is  the  use  of  prooabiiity  theory  in  a  deductive  reasoning 
system,  we  are  interested  in  the  case  where  0  contains  only  two  values.  A  and  —A.  For  this  case, 
the  basic  prooabiiity  function  has  only  three  values,  m(A),  m(-'A),  3nd  m!0).  This  allows  the 
derivation  of  a  simplified  version  of  Dempster's  formula  iPrade.  1983:  Ginsberg,  1984): 


l«  61  led)  =  1 - — - - 

i  l  -  i  ad  -  7c  i 


l  - 


b  a 


<  aa  -  ie  \ 


where  a  means  1 1  -  al.  It  aiso  allows  us  to  formulate  an  inverse  function  for  subtracting  evidence 
Ginsberg,  1984): 


t  a  3  >  —  ■  c  )  = 


- 1  ad  -  be  i 
id-  bee  -  aad 


d[be  -  id) 
id  —  bee  -  add  i 


The  decision  to  choose  Dempster-Shafer  Theory  over  Bayesian  Decision  Theory,  certainty 
factors,  or  some  other  system  of  beliefs  was  purely  pragmatic.  Dempster-Shafer  has  been  snown 


Here  we  ue  'nelief'  'proftaoiiity "  and  "  incertainty '  interchangaoly.  without  mending  a  particular  -ystem  eg  3ay»5 
Charmak,  n  ai  1980,  Pearl.  1983.  1988),  Dempster  -Shafer  Shafer  19761.  Certainty  Factors  Bucnanan  and  Shortiiffe.  1984  m 
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to  be  invertable,  it  distinguishes  between  absolutely  unknown  (no  evidence  or  (0  0) )  and 
uncertain,  and  it  is  simple  to  use.  However,  the  design  of  the  BMS  is  not  based  on  a  particular 
uncertainty  calculus  and  there  should  be  little  difficulty  (as  far  as  the  BMS  itself  is  concerned)  in 
adapting  it  to  use  some  other  belief  system. 

2.2.  A  Logie  of  Beliefs 

The  conventional  meaning  of  two-valued  logic  must  be  redefined  in  terms  of  evidence  so 
that  the  system  can  interpret  and  maintain  its  set  of  beliefs  based  on  the  user-supplied  axioms. 

Not 

Because  Dempster-Shafer  theory  allows  us  to  express  belief  for  and  belief  against  in  a 
single  probability  interval,  (not  A)  and  A  can  simply  be  stored  as  the  same  proposition,  A, 
where 


(not  A)  =  A 

i.  t-  i-  r 

And 

There  are  a  number  of  approaches  to  the  meaning  of  AND.  The  interpretation  used  here 
takes  into  account  the  fact  that  we  are  dealing  with  measures  of  belief  rather  than  probabilities 
and  corresponds  to  that  of  (Garvey  et  ai.  1981): 

A, 

B, 

*-■) 

C, 

nc  i^-/ 


(A  &  B  &  Cl 


The  -2  term  represents  (l  -  cardinality(conjunctsi). 


Both  ’Garvey  et  ai,  1981)  and  1  Rodewaid,  1984)  define  'he  belief  in  OR  ‘o  be  rhe 
maximum  of  rhe  individual  beliefs: 


'hi»|!a,  igj,  m»xiO.  i  -  s  .,-l)i 

IMPLIES 

There  are  two  rheories  in  'ne  literature  for  che  interpretation  of  implies  using  Dempster- 
Shafer.  Dubois  and  Prade.  19851  suggests  that,  for  A  —  B.  we  take  into  account  the  value  of 
BeilB  —  A).  This  causes  the  beiief  in  B  to  oe  derived  as 
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E 

I 

I 

I 

I 

I 


>A  -  B»<.„ 

<B  -  a)(.„  .j 

A,.  .  , 


D 

(max(0,  if,  +  sA  -  1)  m»x(0,  »rt  +■  »A  -  1)) 

Because  the  BMS  should  be  simple  to  use  and  because  Bel(B— ►A)  can  be  difficult  to  obtain,  the 
use  of  implies  will  be  the  same  as  given  in  (Ginsberg,  1984;  Dubois  &  Prade,  1985): 

<A  -  B>(,  .j 

A(’a 


£ 

I 


B 


i 


& 


9 


K*i  *a*h) 

This  adheres  no  the  idea  that  if  full  belief  in  A  implies  B)a,  then  a  half  belief  in  A  should  imply 

b„,4. 

With  these  operators  defined,  the  system  can  parse  all  user  assertions  and  construct  the 
necessary  support  links  with  the  appropriate  belief  functions  attached  to  them. 

2.3.  Support  Links 

A  support  link  consists  of  a  list  of  antecedent  nodes,  a  consequent  node,  its  current  positive 
and  negative  support  for  its  consequent,  and  a  function  for  recalculating  its  support  based  on  the 
current  belief  of  the  antecedents  (when  the  support  is  provided  by  the  user,  forming  a  premise 
link,  no  such  function  exists).  Figure  1  shows  a  sample  support  link  network.  The  system 
recognizes  two  types  of  support  links  -  hard  links  and  invertable  links. 

2.3.1.  Hard  Support  Links 

A  hard  support  link  is  one  which  provides  an  absolute  statement  of  its  consequent's  belief. 
For  example,  statements  of  the  form 
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(implies  x  (and  y  z) ) 

are  translated  into 

(implies  x  y) 

(implies  x  2) 

As  a  result,  nodes  are  never  allowed  to  give  support  directly  to  an  'and”  node  and  the  only 
support  entering  an  "and"  node  must  come  from  the  individual  conjuncts.  A  support  link  for  an 
"and"  node  is  therefore  given  the  status  hard  link  and  the  value  of  the  consequent  node  equals  the 
link’s  support.  In  Figure  1,  if  the  belief  in  A  changes,  a  new  value  is  calculated  for  the 
conjunctive  link  using  its  attached  formula  for  AND,  and  the  node  for  (AND  A  B)  is  set  to  the 
new  value. 

2.3.2.  Invertable  Support  Links 

Links  representing  implication  or  user  support  act  as  only  one  source  of  evidence  for  their 
consequent  node.  Such  links  are  designated  invertable  since  a  change  in  their  support  means  that 
their  oid  support  must  be  subtracted  (using  the  inverted  form  of  Dempster's  rule)  before  the  new 
value  is  added.  In  Figure  1,  if  the  belief  in  D  changes,  then  the  current  support  provided  by  D’s 
link  into  C  is  subtracted,  the  link  support  is  recalculated,  and  the  new  support  is  added  to  C 
(using  Dempster’s  rule). 

2.4.  Control 

The  basic  control  structure  of  the  BMS  is  similar  to  that  of  a  TMS.  When  the  belief  in  a 
node  is  modified,  the  affects  of  this  new  belief  are  propagated  throughout  the  system.  This  is 
done  by  following  the  node’s  outgoing  links  and  performing  the  appropriate  operations  for 
modifying  hard  and  invertable  links’  support.  Propagation  of  evidence  may  be  defined  so  as  to 
terminate  early  (Ginsberg,  1985a).  If  the  system  sees  that  the  change  it  has  just  made  to  a 
node’s  belief  state  is  sufficiently  small,  there  is  no  need  for  it  to  propagate  this  change  to  every 
node  dependent  upon  it.  A  threshold  value,  *propagation-delta‘,  is  defined  so  that,  when  the 
change  to  a  node’s  positive  and  negative  beliefs  are  less  than  the  threshold,  the  system  will  not 
continue  to  propagate  changes  past  this  node.  The  default  threshold  is  10~J. 

In  a  TMS  architecture,  only  one  justification  is  needed  to  establish  truth.  Any  independent 
justifications  are  extraneous.  Using  a  probabilistic  architecture,  each  source  of  support  adds  to 
the  node's  overall  belief.  We  must  keep  track  of  all  incoming  supports,  combining  them  using 
Dempster's  rule  to  form  the  overall  belief  for  the  node.  If  one  tries  to  combine  two  contradicting, 
absolute  beliefs,  1 1  0)  -3  (0  1),  the  system  would  simply  detect  the  attempt  and  signal  a 
contradiction  in  the  same  way  that  a  TMS  would.  Thresholds  could  also  be  used  so  that  if  a 
strongly  positive  belief  is  to  be  combined  with  a  strongly  negative  belief,  the  system  couid  signal 
a  contradiction.  Caution  should  be  used  for  this  case,  however,  because  we  don’t  want  to 
interpret  non-monotonic  inferences  as  contradictions. 

2.4.1.  New  Control  Issues 

Circular  support  structures  like  that  of  Figure  2  cause  a  number  of  problems  for  belief 
maintenance.  Because  of  these  proolems.  the  current  implementation  requires  that  no  such 
structures  exist  and  it  will  signal  an  error  if  one  is  discovered.  There  are  a  variety  of  proolems 
which  the  structure  in  Figure  2  can  cause: 

(I)  Interpretation  of  circular  evidence.  When  A  is  partially  believed  and  the  status  of  E  is 
unknown,  what  can  be  said  about  rhe  support  which  D  provides  to  B’  All  of  the  evidence  D 
is  supplying  to  8  originally  came  from  B  in  'he  first  place.  Because  all  .inks  entering  3  mi! 


UIUCDCS-R-86-1300 


September  198ft 


E 


Figure  2.  Circular  Support  Structure 


combine  according  to  Demoster’s  rule  to  form  a  single  belief.  B  may  be  believed  more 
strongly  than  A  simply  because  B  supplies  evidence  in  favor  of  D  through  C.  This  does  not 
seem  intuitively  correct. 

(2)  Problems  with  possible  cures.  There  are  several  potential  solutions  to  this  problem.  First, 
we  could  simply  allow  D  to  provide  support  for  B.  This  situation  would  appear  to  be 
undefined  under  normal  probability  theory.  Second,  we  could  stop  the  chain  at  D  by  not 
allowing  any  node  to  provide  support  to  one  of  its  supporters  (by  transitivity).  This 
introduces  a  new  problem.  What  should  happen  when  E  is  providing  independent  support 
for  D?  Forcing  the  system  to  only  propagate  those  supports  for  D  which  are  independent  of 
B  would  require  a  much  more  sophisticated  control  structure. 

13)  Retraction  or  modification  of  support.  Modifying  support  links  becomes  much  more  difficult 
if  we  ailow  circular  support  structures  to  exist  in  the  system.  Any  time  the  support  A 
provides  B  changes,  the  old  support  it  provided  must  be  retracted.  This  means  removing 
all  support  from  A.  propagating  the  change  in  B,  adding  in  the  new  support  from  A.  and 
propagating  the  new  belief  in  B.  This  will  cause  the  belief  in  C  to  be  propagated  four  times 
(twice  when  B  changes  the  first  time  and  twice  when  B  changes  ’’he  second  time),  the  belief 
in  D  to  be  propagated  8  times,  etc.  In  addition,  retracting  the  support  A  provides  B  means 
that  we  must  retract  all  support  for  B  (to  remove  the  effects  D  has  on  B),  propagate  rhe 
new  lack  of  belief  in  B.  and  then  recalculate  a  new  belief  for  B  based  on  the  new  value  for  \ 
and  the  current  values  of  its  other  support  links.  Doing  this  every  time  the  belief  for  any 
node  changes  makes  such  a  system  unusable.  When  we  assume  there  is  no  circular  support 
in  the  network,  modifying  our  belief  in  A  simply  involves  subtracting  its  old  support  for  B. 
adding  in  its  new  support  for  B,  and  then  propagating  our  new  oeiief  in  B. 

The  use  of  beliefs  also  causes  probiems  for  systems  that  exDlicitlv  calculate  transitivity 
relations.  Suppose  we  were  to  assert  A  —  C  based  on  the  knowledge  A  — *  B  and  B  — *  C.  This 
action  would  cause  the  system  s  belief  in  C  to  increase,  even  thougn  we  were  simply  making 
information  which  already  existed  explicit. 

2.5.  User  Support 

The  system  has  been  designed  so  that  it  will  appear  to  operate  in  exactly  the  same  manner 
as  the  standard  justification-based  TMS.  Thus,  it  is  able  ro  handle  assertions  using  *he 
connectives  AND.  OR,  NOT,  and  IMPLIES.  If  a  contradiction  occurs,  the  svstem  will  notifv  the 
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user  and  seek  to  resolve  the  contradiction.  In  addition  to  the  normal  TMS  operations,  the  BMS 
supports  additional  operations  corresponding  to  its  belief-oriented  knowledge. 


8 


2.5.1.  Queries 

In  the  TMS,  queries  are  of  the  form  I  true?  -statement).  Now  that  truth  is  measured  in  terms 

of  belief,  we  can  extend  the  query  language.  Truth  is  redefined  in  terms  of  a  threshold,  so  that  a 
belief  over  a  certain  threshold  is  considered  to  be  true. 


§ 


true? 

false? 

unknown? 

absolutely-true? 

absolutely-false? 

absolutely-unknown? 

support-for 

support-against 

possible-true 

possible-false 

belief-uncertainty 


=  belief+(node)  >  ‘belief-threshold* 

=  belief-(node)  >  ‘belief-threshold* 

=  belief+(node)  <  ‘belief-threshold* 
and  belief-(node)  <  ‘belief-threshold* 
=  belief+(node)  =  1.0 
—  belief-(node)  =  1.0 
=  belief+(node)  =  0.0 
and  belief-! node)  =  0.0 
=  belief -“-(node) 

=  belief-(node) 

=  1  -  belief— (node) 

=  1  -  belief-(node) 

=  1  -  belief-(node)  -  belief— (node) 


2.5.2.  F fames  of  Discernment 


In  addition  to  the  default  usage  of  the  simplified  version  of  Dempster’s  rule,  where  each 
node  is  treated  as  a  frame  of  discernment,  0,  containing  |  A,  ->A',  the  user  may  define  a  specific 
frame  of  discernment  by  the  function  call: 


(f rame-of -discernment  node:  node2  .  .  .  noden) 

This  establishes  a  frame-of-discernment  stating  that  the  given  nodes  represent  an  exhaustive  set 
of  possibilities  or  values  in  some  domain.  Evidence  in  favor  of  one  node  acts  to  discredit  belief  In 
the  other  members  of  the  set.  Evidence  may  be  provided  to  support  any  of  the  nodes  from 
outside  the  set.  but  no  support  link  is  allowed  to  change  from  its  initial  non-zero  value.  This  is 
due  to  the  (current)  uninvertability  of  the  general  form  of  Dempster's  rule.  When  new  evidence 
is  provided  for  one  of  the  nodes  in  the  set,  the  belief  in  all  the  nodes  is  recalculated  according  to 
Dempster's  orthogonal  sum  so  that  the  sum  of  the  beliefs  for  the  nodes  in  the  set  is  iess-than  or 
equal-to  one.  The  affect  of  these  changes  are  then  propagated  to  any  support  these  nodes 
provide  to  the  rest  of  the  system. 

In  Figure  3.  the  nodes  !a,  b.  c!  have  been  defined  as  a  frame  of  discernment,  x  provides  0.6 
support  for  a,  j  provides  0.3  support  for  b.  and  z  provides  0.8  support  for  c.  These 
independent  sources  of  evidence  combine  using  Dempster’s  orthogonal  sum  to  form  a  normalized 
set  of  beliefs  ;n  a.  c.  and  c  0.22.  0.06.  0.38  respectively). 

2.8.  Rule  Engine 

Because  the  BMS  does  not  allow  variables  to  exist  in  the  knowledge  base,  pattern-directed 
rules  are  required  to  provide  demons  which  trigger  on  certain  events  in  the  knowledge  base 
iMcAllester.  1980:  Charniak  et  al.  19801.  The  rules  are  of  the  form: 


.■* 


a 


SI 


% 

s 


rmm 

f' 


* 

f 

* 


e: 


4 

I 


3 


Vs"** 


'-OjCa.-.h: 
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> (f rame-of-discernment a  b  c) 

> (assert  (implies  x  a) ) 

> (assert  (implies  y  b) ) 

> (assert  (implies  z  c ) ) 

>  (assert  x 0  6) 

>  (assert  7  0  3) 

>  (assert  z  0  8) 

> (why-nodes) 

X  has  evidence  (0  6,  0  0)  due  to 
USEE  (06,  0.0) 

Y  has  evidence  (0.3,  0.0)  due  to 
USER  (0  3,  00) 

Z  has  evidence  (0  9,0  0)  due  to 
USER  (0  8,  00) 

USER-THETA1  has  evidence  (0  1443,  0  0) 
A  has  evidence  (0  2165,  0  0)  due  to 
IMPLICATION (X)  (0.6,  0  0) 

9  has  evidence  (0  0619.  0  0)  due  to 
IMPLICATION (Y)  (03.0  0) 

C  has  evidence  (0  5773,  0  0)  due  to 
IMPLICATION (Z)  (0  8,  0  0) 


{uncertainty  for  the  entire  frame  -  m(Q)\ 


Figure  3.  An  Example  of  a  Frame-of-Discernment 


(rule  (nested- triggers)  body) 

For  example,  the  rule 

(rule  ( ( : INTERN  (dog  ?x) ) ) 

(assert  (implies  (dog  9x)  (mammal  ’x)))) 

causes  the  implication  (implies  (dogfido)  (mammal  f  ido)  )  to  be  asserted  when  (  dc  g 
fido)  first  appears  in  the  knowledge  base  (whether  it  is  believed  or  not). 

The  rule 

iruia  ((  INTERN  (foo  ’x)  test  (numbers  ’x)  var  ’the-f orm-foo) 

(  BELIEF*  (bar  ’7)  0  8  : var  ’ths-f orm-bar) 

(  BELIEF-  (mumble  ’z)  0  9  var  ’the-f orm-mumble) ) 

(format  t  *"VA  is  been  interned’  ?the-f orm-foo) 

(format  t  *"55The  support  m  favor  of  "A  is  no*  greater  than  0  6"  ’the-form-tar 
(format  t  "-^The  support  against  "A  is  now  greater  than  0  9*  ’the-form-mumol®; 

shows  ail  of  the  pctentiai  operations  in  a  rule.  Each  trigger  contains  a  keyword  le.g.  :I.\TERNi. 
a  pattern  (e.g.  I  foo  ’x)),  an  optional  test  which  must  be  true  for  the  rule  to  fire,  and  an  optional 
var  argument  which  causes  a  specified  variable  to  be  bound  to  the  trigger's  instantiated  pattern. 
There  are  three  types  of  rule  triggers.  The  :  INTERN  trigger  causes  the  rule  to  fire  each  time  a 
new  tact  is  added  ro  the  knowledge  base  which  matches  ’he  given  oattern.  The  BELIEF*  'rigger 


6 


ILL 


Lr, 
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causes  the  rule  to  fire  each  time  the  support  in  favor  of  an  instance  of  its  pattern  first  exceeds  the 
specified  value.  A  BELIEF-  rule  fires  when  the  support  against  its  pattern  exceeds  the  specif <-d 

value. 

3.  EXAMPLES 

There  are  a  number  of  possible  uses  for  a  belief  maintenance  system.  It  enables  us  to 
perform  normal  TMS,  three-valued,  deductive  logic  operations.  It  also  enables  us  to  reason  w.th 
probabilistic  or  uncertain  information.  The  following  sections  discuss  some  of  the  applications 
for  the  BMS. 


3.1.  Two-Valued  Deductive  Reasoning 

The  system's  design  has  enabled  us  to  think  of  it  as  a  superset  of  a  TMS  As  a  result.  we 
can  make  assertions  such  as 

(assert  (implies  a  b)) 

(assert  (implies  ;  , 

(assert  a) 

and  the  system  will  automatically  propagate  the  fact  that  b  and  c  are  true  If  we  then  -•^•>-1 
that  c  was  false,  the  system  would  signal  a  contradiction  and  indicate  'nat  ’he  rontrad '.<■* 
results  from  the  two  user  premises  a  and  (mot  s  (  . 

3.2.  Probabilistic  Reasoning 

In  addition  to  true  false  deductions,  the  belief  maintenance  system  is  able  'o  state  're¬ 
current  partial  belief  in  a  particular  item  and  the  sources  of  this  belief.  For  exampie.  in  Fig  .re  » 
C  has  a  belief  of  0.9  since  all  of  the  belief  in  A  serves  as  evidence  for  Z.  Z.  on  'he  m*" 
has  a  belief  of  only  0.27  since  C  implies  1  by  only  0.3.  E  has  two  sources  of  e\  idenre  1  p r •  ■ .  - 

0.9  evidence  .n  favor  of  E.  while  G  provides  0.J6  evidence  against  E. 


3.3.  Non- Monotonic  Reasoning 

A  belief  maintenance  system  s  able  to  handle  non -monotonic  reasoning  much 
eiegantiy  than  a  two  or  'hree  valued  logic  ;s  aoie  to  Ginsberg.  1984.  198.5b  i.  Consider  \ne  as-.c 
non-monotonic  problem  aoout  birds  n  general "  oesng  able  to  fly.  If  one  were  -o  repiace  i  -u.e 
using  Doyle's  19791  consistency  operator 

birdlXi  A  M  flviX,  —  flyiXl 

with  a  probabilistic  one  stating  that  roughly  90  to  95^  of  all  birds  fly 


i  bird  ’x  I 


iflv  ’x  I 


0  90  0  05) 


the  desired  non-monotonic  behavior  comes  automatically  from  negative  rules  such  as 


i ostrich  ’xl  —  fly  ’xl(q  y 

If  we  know  Tweetv  to  be  a  bird  and  an  ostrich,  'he  two  rules  will  commne  ro  deduce  1:1  j 
0  or  (nob  (fly  t  *  e  e  b  7 )  )  .  No  modifications  of  the  control  structure  are 

needed  to  perform  non-monotonic  reasoning. 
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> (assert  (implies 
> (assert  (implies 
>(assert  (implies 
> (assert  (implies 
> (assert  (implies 
>  (assert  a  0 . 9) 

> (assert  f) 


(or  a  b)  c) ) 
c  d  (0.3  0.0))) 

c  e) ) 

(and  a  f)  (and  g  h))) 
g  (not  e)  (0.4  .  0.0))) 


> (why-nodes) 

F  is  a  premise 

(AND  A  F)  has  evidence  (0.9,  0.0)  due  to 
CONJUNCTION (F  A)  (0.9.  0.0) 

H  has  evidence  (0.9,  0.0)  due  to 
IMPLICATION ((AND  A  F))  (09,  0.0) 

0  has  evidence  (0.9,  00)  due  to 
IMPLICATION ((AND  A  F))  (0.9,  0.0) 

E  has  evidence  (0  8521.  0  0533)  due  to 
IMPLICATION (G)  (0.0,  0.36) 

IMPLICATION (C)  (0  9,  00) 

D  has  evidence  (0.27,  0.0)  due  to 
IMPLICATION (C)  (0.27,  0.0) 

B  is  unknown 

A  has  evidence  (0.9,  0.0)  due  to 
USER  (0  9,  0.0) 

(OR  A  B)  has  evidence  (0.9,  0.0)  due  to 
DISJUNCTION (B  A)  (09,  0.0) 

C  has  evidence  (0.9,  0.0)  due  to 
IMPLICATION ((OR  A  3))  (0  9,  0.0) 


Figure  4.  Probabilistic  Deductive  Reasoning 


4.4.  Rule-baaed  Pattern  Matching 

The  belief  maintenance  system  has  been  used  to  implement  a  rule-based,  probabilistic 
pattern  matching  algorithm  which  is  able  to  form  the  type  of  matching  typical  in  analogies  in  a 
manner  consistent  with  Gentner s  Structure-Mapping  Theory  of  analogy  (Gentner.  1983: 
Falkenhainer.  Forbus,  &  Gentner,  1986).  For  example,  suppose  we  tried  to  match 

(AND  (CAUSE  (GREATER  (PRESSURE  beaker)  (PRESSURE  vial)) 

(a)  (FLOW  beaker  vial  water  pipe)) 

(GREATER  (DIAMETER  beaker)  (DIAMETER  vial))) 

with 

(AND  (GREATER  (TEMPERATURE  coffee)  (TEMPERATURE  ice-cube)) 

(b)  (FLGW  coffee  ice-cube  heat  bar)) 

A  standard  unifier  would  not  be  able  to  form  the  correspondences  necessary  for  those  two  forms 
to  match.  First,  the  forms  are  different  in  their  overall  structure.  Second,  the  arguments  of 
similar  substructures  differ,  as  in  (FLGW  beaker  vial  water  pipe)  and  (FLGW  coffee 
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ice-cube  heat  bar).  The  rule-based  pattern  matcher,  however,  is  able  to  find  all  consistent 
matches  between  form  (a)  and  form  (b).  These  matches  correspond  to  the  possible 
interpretations  of  the  potential  analogy  between  (a)  and  (b).  They  are 

(GREATER  (PRESSURE  beaker)  (PRESSURE  vial))  - 
l1)  (GREATER  (TEMPERATURE  coffee)  (TEMPERATURE  ice-cube)) 

(FLOW  beaker  vial  eater  pipe)  <-  (FLOW  coffee  ice-cube  heat  bar) 

(GREATER  (DIAMETER  beaker)  (DIAMETER  vial))  « 

(2)  (GREATER  (TEMPERATURE  coffee)  (TEMPERATURE  ice-cube)) 

The  pattern  matcher  works  by  first  asserting  a  match  hypothesis  for  each  potential  predicate  or 
object  pairing  between  (a)  and  (b)  with  a  belief  of  lero.  For  example,  we  could  cause  all 
predicates  having  the  same  name  to  pair  up  and  all  functional  predicates  (e.g.  PRESSURE)  to 
pair  up  if  their  parent  predicates  pair  up  (e.g.  GREATER).  The  likelyhood  of  each  match 
hypothesis  is  then  found  by  running  match  hypothesis  evidence  rales.  For  example,  the  rule 

(assert  same-functor)  !  provide  a  name  for  the  source  of  the  rule's  support  } 

(rule  ((  intern  (MH  ’ll  ’i2)  test  (and  (fact’  ’ll)  (fact’  ’i2) 

(equal-functors  ’ll  ’i2)))) 

(assert  (implies  same-functor  (MH  ’il  ’i2)  (05  00)))) 

states  “If  the  two  items  are  facts  and  their  functors  are  the  same,  then  supply  0.5  evidence  in 
favor  of  the  match  hypothesis."  After  running  these  rules,  the  BMS  would  have  the  beliefs  shown 
in  Figure  5. 


Match  Hypothesis 

Evidence  j 

(MH 

GREATER^. 

GREATER-..^.) 

0.650  ! 

(MH 

GREATER^ 

GREATER^.^.) 

0.650  i 

(MH 

PRESSURE^,, 

TEMPERATUREco(rJ 

0.712  ! 

(MH 

PRESSURE.,  . 

TEMPERATURE.^^J 

0.712  j 

(MH 

DIAMETER^., 

TEMPERA  TURE5#fffJ 

0.712 

(MH 

DIAMETER^ 

TEMP  ERA TURE^J 

0.712 

(MH 

FlOWwmwr  FLOWh<J 

0.790 

(MH 

beaker  coffee) 

0.932 

(MH 

vial  ice-cube) 

0.932 

(MH 

water  heat) 

0.632 

(MH 

pipe  bar) 

0.632 

Figure  5.  BMS  State  After  Running  Match  Hypothesis  Evidence  Rules 
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The  pattern  matcher  then  constructs  all  consistent  sets  of  matches  to  form  global  matches 
such  that  no  item  in  a  global  match  is  paired  up  with  more  than  one  other  item.  (1)  and  (2)  are 
examples  of  such  global  matches.  Once  the  global  matches  are  formed,  the  pattern  matcher  must 
select  the  “best”  match.  To  do  this,  a  frame  of  discernment  consisting  of  the  set  of  global 
matches  is  created  and  global  match  evidence  rules  are  used  to  provide  support  ior  a  giobai 
match  based  on  various  syntactic  aspects  such  as  overall  size  or  “match  quality”.  For  example, 
we  could  have  match  hypotheses  provide  support  in  favor  of  the  global  matches  they  are 
members  of.  Thus,  the  pattern  matcher  would  choose  global  match  (1)  because  the  match 
hypotheses  provide  the  most  support  for  this  interpretation.  This  is  a  sparse  description  of  the 
matching  algorithm  discussed  in  (Falkenhainer  et  al,  1986). 

4.  CONCLUSIONS 

The  design  of  a  belief  maintenance  system  has  been  presented  and  some  of  its  possible  uses 
described.  This  system  differs  from  other  probabilistic  reasoning  systems  in  that  it  allows 
dynamic  modification  of  the  structure  of  the  knowledge  base  and  maintains  a  current  belief  for 
every  known  fact.  Previous  systems  have  used  static  (compiled)  networks  (Pearl,  1983,  1986; 
Buchanan  et  al,  1984)  which  cannot  be  dynamically  modified  or  simple  forward  chaining 
techniques  which  don’t  provide  a  complete  set  of  reason-maintenance  facilities  (Buchanan  et  al, 
1984;  Ginsberg,  1984,  1985). 

There  are  still  a  number  of  unsolved  problems.  First,  the  interpretation  and  efficient 
implementation  of  circular  support  structures  needs  to  be  examined  further.  Second,  operations 
such  as  generating  explicit  transitivity  relations  cause  new  problems  for  belief  based  reasoning 
systems.  What  is  important  to  note  is  that  the  basic  design  is  independent  of  the  belief  system 
used.  For  any  given  uncertainty  calculus  which  is  invertable,  the  assertion  parser  can  be 
modified  to  construct  the  appropriate  network. 
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